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We discuss a new optimization strategy, which considerably improves the effectivity of evolutionary 
algorithms applied to a certain class of optimization problems. The basic principle is to solve first 
a simpler related problem, which is constructed by introducing additional degrees of freedom to the 
landscape. Starting from the solution in this simplified landscape we remove stepwise the added 
degrees of freedom. Our optimization strategy is demonstrated for a sample problem. 



1. Introduction 

Evolutionary algorithms have been shown by many 
authors (e.g. lid) to be suited for solving complex 
optimization problems, and there are a highly de- 
veloped theory of evolution processes I and lots of 
recipes for successfully applying evolutionary algo- 
rithms Ell. Particularly in combinatoric optimiza- 
tion where many other standard techniques fail, 
considerable success has been achieved by using 
evolutionary algorithms. Obviously, each particu- 
lar optimization problem could be solved more ef- 
fectively (i.e. less computer time consuming) by a 
deterministic algorithm, provided the algorithm is 
known. The main advantage of evolutionary algo- 
rithms is their simplicity and universality. In most 
cases evolutionary algorithms can be parallelized in 
a trivial way by distributing the individuals among 
a set of parallel processors. This may be considered 
as another advantage. 

One of the most well-known examples, which 
has drawn the attention of scientists from vari- 
ous disciplines, is the Travelling Salesman Problem 
(TSP). In its standard formulation, the TSP has 
been proven to be NP complete □, and many au- 
thors have tried to tackle this problem using differ- 
ent types of evolutionary strategies as well as other 
methods (e.g.0ffi@S@). 



To apply an evolutionary algorithm one has to 
provide two essential ingredients: First, one needs a 
fitness function which evaluates a solution. This fit- 
ness function must be calculable very effectively (in 
terms of computer time) since it has to be evaluated 
extremely often during the calculation. Hence, the 
fitness function is required to be simple. Second, 
one needs a mutation operator which takes into ac- 
count the topology of the fitness as a function of the 
parameters to be optimized. If the mutation oper- 
ator does not care about the topology it happens 
that even a small mutation may lead to an extreme 
change in the fitness, and hence, the evolution al- 
gorithm turns into stochastic search. Examples can 
be found in the literature where either the first or 
the second precondition is violated and where the 
evolutionary algorithm does not work effectively. 

In the present paper we investigate an evolution- 
ary game where each individual is a set of points, 
i.e. a team, which solves a well defined problem by 
cooperative behavior, i.e., by "team work". In the 
beginning neither the number of points per team 
N m in which is necessary to solve the problem nor 
the detailed solution is known. Both have to be 
found during the evolutionary game. Formally, one 
can consider the solution to be a subspace of the 
configuration space of dimension 2 N m i n . 

It will be shown that even if we knew the number 
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of necessary points it would be favourable to solve 
first a simpler problem, in which the teams consist 
of more points than necessary, and then stepwise to 
increase the complexity of the problem by reducing 
the number of points. Solving such a hierarchy of 
problems and using the solution of a simple problem 
as the initial condition for the next difficult problem 
can be much more effective. 

2. Description of the Problem 

Assume we have a complicated shaped room with 
polygonal ground-plan. The M even walls of the 
room have to be illuminated completely using a set 
of N light bulbs. The questions which will be inves- 
tigated here are: How many light bulbs are needed 
at minimum to illuminate the walls of the room, 
and where to place them? 

Although we cannot provide a proof for JVP- 
completcness of the problem, probably most people 
will agree that this problem is complex in the gen- 
eral case. There is a short proof for the upper 
limit of bulbs needed to illuminate a room bounded 
by M even walls 13. Provided that the room does 
not have columns one does not need more than 
N = [M/3\ bulbs, where [a J denotes the integer 
of a. Figure 1 displays a room where one needs 
indeed N — [M/3\ bulbs. In many cases, however, 
significantly less than N = [M/3J are necessary for 
complete illumination. We want just to note that 
for the case that the room has S inner columns 
(of polygonal cross section) one claims (El) that 
N = [(M + S)/3\ lamps are needed, where M in- 
cludes the number of walls of the room and of the 
columns. So far, however, there is no proof. 




Fig. 1. In the drawn case of a room with 15 walls 
we find the worst case where N = [1 5/ 3J = 5 
light bulbs will be needed to illuminate the walls 
completely. The dots show the positions of the 
bulbs. 



* Since the problem is two dimensional we may call the length of 



A related nroblem is the so called gallery watch- 
man probleuu. The question here is how many 
(static) watchmen are needed to watch the walls 
of a museum (e.g. E3), or in the dynamic formu- 
lation what is the shortest path of a watchman 
to pass through all points of interest. There are 
many formulations of the watchman problem and 
much theoretic work has been done in this field 
(e.g. 00100). A technical application of a 
one dimensional version of the dynamic watchman 
problem solved by an evolutionary algorithm was 
recently investigated by Heckman A machine 
consisting of a number of pickers assembled in a 
linear array across a conveyor belt was optimized 
to pick up pieces which move on the conveyor. The 
algorithm had to decide which of the pickers picks 
up the next coming piece. 

In the case of our problem we assume that the 
room has no columns, therefore the number N m i n of 
actually needed lamps is always less than the third 
of the number of walls N m i n < [M/3J . The fitness 
F of an individual, i.e., of a set of light bulbs, is 
given by the illuminated area*of all walls 

M 

Eh 
E k 

where fcj is the illuminated area of the «th wall and 
li is its total area. Hence we find for the fitness 
F G [0,1]. During the optimization we try to maxi- 
mize F by changing the positions of the light bulbs. 
The solution is found when we have determined the 
positions of the minimum of a number of bulbs to 
illuminate the room, i.e. F = 1. The function F is 
embedded in the 2N dimensional space of the co- 
ordinates of the N bulbs. It may have a complex 
topology, in particular numerous discontinuities, lo- 
cal extrema and flat plateaus. Hence a simple gra- 
dient strategy would fail to find the optimum and 
one has to chose a more sophisticated optimization 
strategy. In light of the generally_Lised classification 
scheme introduced by Schwefel E2l our algorithm is 
of (fi, A)-type. 

Each individual a, (a = 1 . . . (a) in our evolu- 
tionary game is a set of N max > N > N min light 
bulbs, where N max — [M/3\ and N m i n is the (un- 
known) minimal number of bulbs which are needed 

a certain part of the border of the room area. 
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to illuminate the room. The algorithm starts with 
[i of such individuals, the positions i = 1 . . . N 
of the lamps are random. The optimization scheme 
reads as follows: 

1. The individuals are mutated by varying the 
position of each lamp 

S?^S?+m w -A°, (2) 

with i £ [1,AT] and a S [1,/i]- The compo- 
nents of the two dimensional vector Af are 
chosen equally distributed from the interval 
[0,1]. The mutation step length m w is con- 
stant. To avoid that the individuals persist 
in deep local maxima, with a small frequency 
P the new position of a lamp is completely 
random. 

2. All individuals are rated by means of the fit- 
ness function ([!]). 

3. If no set a 6 [1 . . . fj] solves the problem, i.e. 
F a 7^ 1, the A sets of lamps (individuals) 
with the highest fitness values are copied and 
brought over to the next generation. The re- 
maining fi — X individuals die out. Steps 1 to 
3 are to be repeated until at least one of the 
individuals has the fitness F a = 1. 

4. If at least one individual has fitness F = 1, 
the solution is found and we start to solve the 
next difficult problem, i.e., we try to solve the 
same optimization problem, now with each 
individual consisting of N — 1 lamps only. 
The solution of the previous problem with N 
lamps is used to initialize the new positions of 
N — 1 lamps per individual: The winning in- 
dividual with fitness F — 1 is copied (i times 
and for each individual one randomly chosen 
lamp is removed. Then we start the new opti- 
mization run with N — 1 bulbs beginning with 
item 1. 

This procedure is continued until no solution can 
be found anymore. The last solution, found by the 
algorithm will be assumed to be the solution of the 
optimization problem stated at the beginning of 
this paragraph. 



3. Results and discussion 

The proposed algorithm was applied to illuminate 
a room [M = 82) with the ground-plan shown in 
Fig. 2. The solution given by AT TOin = 10 crosses was 
found during an evolutionary game of /i = 60 indi- 
viduals. The optimization parameters were A = 5, 
P = 10~ 3 and m w = min(x max ,y max ) ■ 10~ 2 where 
Xmax and Umax denote the maximum extent of the 
room in the x- and y-directions respectively. 




Fig. 2. Solution with N m i n = 10 lamps for 
an arbitrary created room with M = 82 walls. 
The position of the lamps are drawn with (+)- 
and (*)-symbols. The room is completely illumi- 
nated, one can easily check that each place of the 
wall can be connected by a straight line with at 
least one lamp without intersecting the wall. The 
shadowed area displays the section which is illu- 
minated by the lamp which position is given by 
the (*)-symbol. 

The parameters were chosen to give a satisfying 
efficiency of the optimization for a much simpler 
room. We did not further optimize these parame- 
ters, because the aim of the paper is to present a 
new optimization scheme but not to improve the ef- 
ficiency of the well-known evolutionary algorithm. 
For The optimization of the parameters see e.g. 
ref. 0. 

In Fig. 3 the fitness Fj of the fittest indi- 
vidual / is plotted versus the number of evolu- 
tionary steps. We start up with random sets 
of N — N m i n — 10 lights. The fitness is not 
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monotonously increasing in time but there are 
long periods of stagnation interrupted by rapid 
jumps in the fitness. (Note that the abscissa is 
drawn in log scale.) This behavior, which seems 
to be typical for evolutionary processes was ob- 
served bv several authors for various problems be- 
fore, e.g. E3, and substantiated theoretically (seeQ). 
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Fig. 3. Time evolution of the fitness F of the 
best individual for four runs starting with differ- 
ent initial conditions. There are long periods of 
nearly constant fitness interrupted by short peri- 
ods of rapid fitness increasing. 

Usually a priori we do not know the number 
N m in of lamps needed to illuminate the room and 
we start the optimization procedure with iVo > 
Nmin lamps per individual. But even if we would 
know the number it would be favourable to start 
with a larger amount of lamps than needed. In the 
following we will show and explain, that the algo- 
rithm for our optimization problem is up to about 
10 times faster for that case. 

To ensure approximately the same amount of 
computer time for each evolutionary step unaffected 
by the number of lamps each set consists of, the 
number of individuals /i was chosen 



N„ 



M = Mr, 



Nn 



(3) 



where fJ, ma x = 60 is the number of individuals for an 
optimization starting with Nq = N m in light bulbs 
per individual. Hence, we can identify the num- 
ber of evolutionary steps with time when we as- 
sume that the computer time needed for each step 



is mainly determined by the time required to calcu- 
late the fitness, i.e., it is proportional to the total 
amount of light bulbs. 
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Fig. 4. Number of optimization steps t to find the 
final solution versus the number of bulbs Nq in 
the starting iteration. The computer time which 
is proportional to the number of iteration steps 
decreases with increasing No and reaches a min- 
imum at A*o = 16. For larger No the value in- 
creases slowly. 

Fig. 4 shows that the algorithm is in average 
about 10 times faster if one starts with sets con- 
sisting of Nq — 16 lamps instead of the required 
N m in = 10- Each data point in this figure is the 
mean value of the needed optimization steps of five 
runs with different starting configurations. The 
data show that the time needed to compute the so- 
lution decreases with increasing starting number of 
lamps for No < 16. When we start with larger sets 
iVo > 16 the computer time increases slowly. There 
are two mechanisms responsible for this behavior: 

1. Suppose we would do stochastic search, and 
suppose there would be a unique solution for 
the optimization problem. If we assume that 
t is the time a single searcher needs to find 
one particular of the N m in places then TV ran- 
dom independent searchers need the time 



(4) 



NN„ 



to find any of the places. The aspect of 
team work is included by assuming that a 
searcher who has found "its place" will not 
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leave this place until the solution of the prob- 
lem is found: It will survive the following evo- 
lutionary steps. Then we find for the time to 
find all places, i.e. to solve the optimization 
problem 



T(N)= J2 



(A - i) (N min - i) 



(5) 



By replacing the sum by an integral we get 
the analytic solution 



T(A) 



(N - x) {N„ 



x) 



dx 



' In 



2N-1 

(2jV mi „-l)(2iV-2jV mi „ + l) 



N„ 



A 



(6) 



Obviously T(N)-T(N+1) is a positive num- 
ber, i.e. the solution will be found quicker 
when starting with N+ 1 lamps instead of A. 
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Fig. 5. Number of optimization steps TV versus 
the number of lamps A. The averaged data over 
five runs of the evolution algorithm are drawn 
by crosses and error bars. The full line and the 
dashed line show the estimates due to eq. (||) and 
the last term of the sum in eq. (^|) respectively. 
The time r has been assumed to be a fit param- 
eter. 

Apart from this simple estimate we realize 
that typically the "attractor regions" for the 
positions of the bulbs do not have the same 



size but their sizes differ significantly. Usu- 
ally the positions with the smallest "attrac- 
tors" are found at the end of the optimiza- 
tion procedure, and the time is mainly deter- 
mined by the last term of the sum in eq. (||). 
To provide better estimate one needs knowl- 
edge about the fitness landscape of the prob- 
lem. For very simple problems it has been 
shown that one can conclude the properties 
of convergence based on knowledge od s^tis 
tical properties of the fitness landscape 



rt 



Fig. 5 shows the results from the optimization 
as well as the discussed estimates. 




Fig. 6. Sample optimization runs. After finding a 
solution for Nq > N m i n lamps the algorithm finds 
quickly the solution for smaller N. In accordance 
with fig. 4 the algorithm becomes slightly less ef- 
fective when starting with larger Ao (Explanation 
see text). 

Fig. 6 shows the progress of the optimization 
procedure for A = {16,18,20,22} lights in 
the starting configuration. One should read 
the figure from right to left: the ordinate 
shows the number of evolution cycles which 
have been necessary to solve the problem for 
A lamps. In the case of the run started 
with Ao = 18 light bulbs the solution for 
A = N m i n was found almost exclusively by 
removing lights. 

Fig. 4 shows that the optimization time rises 
slightly for large Ao. Comparing the solu- 
tions of one optimization run for different A 
we note that for Ao ~ 18 the initial solution 
(for A = Ao) is frequently very close to the 
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final solution (for N = N m i n ). Hence, the so- 
lution for N — 1 lamps can be found from the 
solution for N lamps just by deleting one of 
the lamps and performing few evolution steps 
(see Fig. 6). 

For A*o ~ 18 the initial solution could differ 
very much from the final solution, and also the 
solutions of the successive problems for No, 
iVo — 1 . . . , N m i n differ from each other. The 
solutions are not really adapted to the geome- 
try of the room, but they are more the results 
of a random search. Therefore the system 
does not take too much advantage from know- 
ing the solution for N lamps solving the prob- 
lem for N — 1 lamps. Hence the calculation 
time in Fig. 4 rises slightly for larger values 
of N. Nevertheless the algorithm is still much 
faster compared with the time needed for the 
solution starting with N = N m i n bulbs. 

The situation is quite similar to a neural net- 
work applied to a pattern recognition prob- 
lem: if it has too many neurons the network 
just stores the patterns instead of finding 
characteristic features (e.g. 113). If this net- 
work is applied to an unknown pattern it fails 
since none of the stored patterns has enough 
overlap with the unknown pattern. A network 
with less neurons might be able to solve the 
problem since it checks whether the unknown 
pattern reveals characteristic features. 

4. Conclusion 

We have shown that for the investigated prob- 
lem it is favourable to start the optimization with 
more points than necessary No > N m i n . First we 
find a solution, i.e. the positions of the points for 
a higher number of points, and then we stepwise 
decrease N while using the solution for TV as initial 
condition for finding the solution for N — 1 points. 
It turns out that the procedure to solve the chain 
of problems for N ,N — I, No — 2, ... , N min is up 
to about ten times faster then to solve the prob- 
lem for N m i n directly. Formally we first solve the 
optimization problem in a high dimensional space 
of dimension 2Nq. Once the solution is found we 
stepwise reduce the dimensionality and end up with 
dimension 2N m i n . 



The theoretical basis of the optimization 
speedup in higher dimension is provided by Morse 
theory Qualitatively Morse Lemma says that 
under rather mild assumptions the fraction of sad- 
dle points of a function of its critical points rises 
with dimension. Hence the relation of extrema and 
saddle points decreases when increasing the dimen- 
sion. The idea of the lemma becomes clear in one 
and two dimensions: to reach the optimum of a one 
dimensional function one has to "walk through" all 
local extrema in between the starting point and the 
global extremum. In two dimensions in many cases 
one can "walk around" local extrema and hence one 
avoids time consuming escape procedures. Simi- 
lar in higher dimension: the higher the dimension 
the more bypasses do exist to reach a certain point 
without getting stuck in local extrema. 

We assume that this behavior is typical for a 
certain class of optimization problems. The main 
characteristic of this class is that the problem can 
be transformed into another problem containing 
a parameter N where the solution of the original 
problem with the parameter being N* is contained 
in the set of solutions of the easier to solve prob- 
lems with TV ^ N* . Obviously the entire class of 
coverage problems belongs to this class. Further 
investigations will be necessary to substantiate this 
hypothesis. For the problem of the travelling sales- 
man, for instance, the easier task could be to find a 
minimal length where some cities (N) are allowed 
to be visited twice, followed by a successively re- 
duction of the number of those cities. 
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